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METHODS AND SYSTEMS FOR CONTROLLING 

CONSUMER ELECTRONICS EXTERNAL 
DEVICES VIA DATA DELIVERED TO A DEVICE 

5 Cross-Reference to Related Applications 

This application claims priority under U.S. law to U.S. serial nos. 
60/213,058, filed June 21, 2000; 60/214,529, filed June 27, 2000; 60/231,180, 
^ filed September 7, 2000, serial no. 09/752,267. filed December 29, 2000, 
each of which are owned by the assignee' of this application and each of 
10 which applications are incorporated in its entirety by this reference. 

Technical Field 

This invention deals with methods and systems for delivering and 
executing at a Set Top Box ("STB") or other consumer electronic device, 

15 control or program data, whereby the STB interfaces with various external 
devices for sending or receiving instructions or information to those devices. 
Exemplary embodiments are illustrated, including methods and systems for 
supplementing delivered programming with Internet programming via a PC or 
Internet appliance coupled to the STB, controlling environmental equipment 

20 such as home theatre equipment, and managing programming scheduling via 
interface with a personal digital assistant ("PDA"). 

Background of Invention 
Modern cable, satellite, wireless or other communications networks 

25 deliver a host of programming content and other data to viewers' premises, 
each of which generally is outfitted with a STB or Consumer Electronics 
device ("CE device") for decoding and displaying the programming. STBs are 
usually low-cost devices and, due to engineering constrains, presently lack 
the necessary processor speed, memory and components to support Internet 

30 applications or advanced data gathering capabilities. However, many STBs 
do have the capability to communicate with an external device through one of 
several communication mechanisms, such as an IR blaster, serial port, 
modem, or expansion bus peripheral. These communication devices have 
not in the past been used for much more than entering typical scheduling and 

35 control data into the STB, however. 

1 
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Scheduling has been made easier because part of the programming 
delivered to STBs are Electronic Program Guides CEPGs"). These guides 
provide a viewer with program scheduling information, e.g. a program's 
channel or ottier characteristics of the program such as whether the program 

5 supports particular protocols like Dolby AC-3 sound, etc. EPGs also can be 
used to accomplish other useful tasks, such as instructing a STB to tune to a 
program based on user preferences or instructing a VCR to record a program. 
Indeed, some EPGs offer the ability to create reminders for program start 
times. These reminders usually appear as visual alerts on the television 

10 screen when the program is about to begin. However, if the user is not 
watching television at the time these alerts occur, they are of little value. 

Summary of the Invention 
Certain temis used in this section are described more fully below, 

15 particularly in the "Tenninology" session. This invention aims to provide 
systems and methods to leverage existing technologies located at a viewer's 
premises, e.g., the viewer's PC, existing PC Internet connection, STB, and 
existing EPG data delivery format, to deliver, receive and act upon information 
and instructions for certain external devices. Exemplary implementations are 

20 described where: (1) an STB is connected to a viewer's PC and an 

application, residing on the STB. retrieves data fi-om the PC using special tags 
embedded in EPG program data or accesses a host of special Internet related 
applications while viewing other programming; (2) an STB makes use of 
information added to or already included in EPG program data to control 

25 aspects of the user's home theater environment during a TV program; (3) an 
STB communicates with an application on a Personal Digital Assistant (PDA) 
to set reminders about programming, for example, start times, etc. or 
download program infomriatlon to the PDA for storage and display, etc. 
Program Supplementation : In one embodiment, control tags are 

30 Inserted into the data stream that provides STBs with the EPG data. An 

application residing on the STB identifies the control tags, strips them out and 
processes the instructions therein. The instructions may cause the STB to 
communicate with a PC, internet appliance or other computing device that 
has been coupled to the STB via any of various known communication 
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mechanisms. The STB thereby can take advantage of the functionality, 
processing power and display capabilities of the computing device. Using this 
capability, an STB can supplement its limited capabilities by using the 
processing power of the PC and the information gathering ability of a PC 
5 connected to the Internet. By way of example, tags delivered to the STB may 
cause it to retrieve Internet data via the user's PC or Internet appliance. That 
Internet data can be used to supplement EPG data on the STB or display data 
synchronized to a currently playing event Alternatively, retrieved Internet 
data may be stored on the PC for immediate or later viewing. 
10 Environmental Control : In another embodiment, the tags embedded in 

the EPG data stream (or the programming itself) comprise certain control data 
that correlate to a particular program or event. The control data describes 
how the user's home theater equipment (e.g., stereo, wall-screen TV, 
thumpers, scent extractors, etc.) should be optimally controlled during the 
15 program presentation. Control data can be used to do such things as 
configure home audio equipment to best accommodate a program's 
soundtrack, adjust VJ picture settings, automate room lighting, mute 
commercials, or even "censor" portions of a TV program. 

PDA Interfacing : Many people now carry PDAs, which provide 
20 scheduling and task management capabilities. This invention also provides 
methods for allowing external devices like PDAs to interface with the STB in 
order to display alerts or other infomnation concerning programming using the 
PDA unit's built-in calendar and alarm capabilities. Similarly, the PDA may be 
configured to send information to the STB application, for example, instructing 
25 it to set reminders for programs or to automatically record programs on a 
VCR, DVR or other storage medium. 

This invention aims to achieve one, combinations, or all of the following 
objectives: 

• To formulate program control data associated with discrete portions 
30 of programming, which contain information related to controlling 

presentation of the programming by controlling the manner in which 
various home theatre or other display and audio devices should be 
controlled; 
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• To provide an STB that receives and processes control data and 
communicates instructions therefrom to external devices coupled to 
the STB; 

• To formulate control data that describes when and how to access 

5 supplemental program data, such as data from an Internet Website, 

via a user's PC, Internet appliance or other computing device; 

• To provide methods for coupling an STB to a user's PC, Internet 
appliance or other computing device in order to exchange 
information and instmctions. 

10 Other objects, advantages and features of this invention will be apparent from 
review of the remainder of this document, including the drawings. 

Brief Description of Drawings 
Figure 1 is a diagram illustrating an embodiment of a system for 
15 controlling a home automated network using ERG tag information according 
to the present invention. 

Figures 2A-C are diagrams illustrating methods of connecting the STB 
to the home automated network described in Figure 1. 

Figure 3 is a diagram Illustrating an embodiment of a system for 
20 facilitating communications between a STB and a PDA according to the 
present invention. 

Figures 4A-C are diagrams illustrating methods of connecting the STB 
to the PDA described in Figure 3. 

Figure 5 is a diagram illustrating a networked control system, including 
25^ . a PC. according to the present invention. 

Figures 6A-E are diagrams illustrating methods for connecting the STB 
to the PC described in Figure 5. 

Detailed Description 

30 I, Temninology : 

Before further describing a particular implementation of the present 
invention that is shown in the drawings, the following terms are explained, 
although more thorough understanding of the terms can be reached by 
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resorting to this entire document. Tliese term explanations are not intended 
to be conclusive, as technology will change and sl<illed persons will recognize 
other ways to implement the same functionality. 

• "Communications network" includes any network or infrastructure 
5 that supports communications between multiple devices, including 

broadband distribution networks, public or private packet-switched 
or other data networks, including the Intemet, or circuit-switched 
networks such as the public switched telephone network and 
wireless networks. 

10 • "Consumer electronics device" or "CE device" is any electronic 

device or combination of devices'capable of receiving, displaying, 
playing, presenting, recording, deleting, editing, substituting, or 
disabling audio and/or video content. Exemplary CE devices 
include: televisions, personal computers, cable set-top boxes, 

15 video cassette recorders, digital video recorders, digital video disc 

players, compact disc players, and personal computers. 

• "Content data" is any infomnation conresponding to at least a portion 
of a program and related to the content of the program, including 
content ratings and content attributes, traits, or characteristics. 

20 • "Control data" is any infomnation conresponding to at least a portion 

of a program and related to the manner in which the portion may be 
disabled, modified, replaced, deleted, edited, or othenA^ise modified 
by a consumer electronics device, set top box or tine like. 

• "Program" or "Programming" is any electronic presentation of 

25 information, such as text, audio, video, graphics, or any other form, 

of multimedia, over a communications network. Exemplary 
programming includes: Intemet programming, television 
broadcasts, cable television programming, pay-per-view 
programming, video-on-demand, interactive television 

30 programming, satellite programming, and multimedia presentations. 

• "Program data" means content or control data or other data 
associated with or describing the content or manner of presentation 
of programming. 
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• "Service provider" is any entity that delivers programs to a program 
viewer, including cable providers, television broadcasters, satellite 
providers, and entities supporting Intemet World Wide Web ("Web") 
sites. 

5 II. Svstem Overview - EPG Environmental Control 

Briefly. Figures 1 , 3 and 5 show system components for delivering data 
that controls various devices that assist in the optimal presentation of 
programming. In the subscriber's premises, a Set-Top Box 3 connects 
through a distribution network 2 to a headend 1 . Set-Top Box 3 also 

10 connects to the subscriber's consumer electronic (CE) device 4. for example a 
VCR. stereo, computer, etc. and/or home automation network 5. The CE 
device 4 is in turn connected to the Intemet through an Intemet service 
provider. As skilled persons will acknowledge, instead of STB 3, the invention 
could be implemented using software and hardware associated with a CE 

15 Device, such as a TV 8. 

A. STB - CE Device Connection 

Set-Top Box 3 can be connected to CE device 4 and/or home 
automation network 5 through a variety of means. Some detailed examples 
are listed below. The hardware details of the STB-home theater connection 
20 are provided here for technical reference only and the invention is not limited 
to such details. 

1) Using an IR blaster connected to the STB's IR blaster port, the STB 
may use IR signals to communicate with consumer electronic devices 
such as a stereo amplifier or a home automation network. (Figures 2A) 

25 2) Using the STB's serial port, the STB may connect to a peripheral that 
converts the RS-232 signals used by the STB into a standard signal 
used by CE devices and home automation networks. Such signals 
Include signals in the IEEE 1394 (aka: Firewire) or CEBus (Figures 
2B> formats. 

30 3) Using the STB's expansion bus, the STB could be connected to the 
peripheral described above, as shown in (Figure 2C). 

B. Data Tags 

Headend 1 houses an EPG Data Server 6 that collects program data 
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from a data provider. The program data includes information on each TV 
program such as the program title, start time, duration and description. EPG 
Data Server 6 sends the program data through distribution network 2 to Set- 
Top Box 3 located in the subscriber premises. Some of the applications listed 

s in the next section may be accomplished by using information already 

contained within the EPG data, such as a program's start time and Dolby AC- 
3 indicator. However, specific control by the EPG must be carried out using 
special data refenred to as "tags," which according to this invention are added 
to EPG program data to provide more detailed information on controlling the 

10 user's home theater environment. The tags instmct the STB application to 
send control information to specific CE devices and/or home automation 
networks during the course of a program. For instance, a tag may instruct the 
STB to configure a stereo amplifier, adjust the TV picture, and dim the lights 
at the start of a program. A tag may also indicate times at which commercials 

15 or possibly objectionable content occun'ed during a program and send 
instruction to a TV to mute or blank those portions of the program. 

The tags may be added to the EPG data by the EPG data provider or 
could be added by an optional device in headend 1 referred to as the "Home 
Control Tag Server" 7. In this latter case, the EPG Data Server 6 sends the 

20 EPG data to the Home Control Tag Server 7, which in turn inserts special 
data referred to as "tags" into the program data for particular TV programs. 

Tags may be classified as fixed or variable tags; "Fixed Tags" specify 
a parameter for the entire length of a program while "Variable Tags" vary a 
parameter at different times during a program. An example of a variable tag 

25 would be one that mutes TV commercials. 

The tag would be encoded as a special ASCII string and could include 
the following elements: 

1) Command. A command may be an instruction that an applet on the 
STB send control instructions to specific CE devices and/or a home 

30 automation network. For instance, the command could be "Switch 

Tuner to Dolby Surround Sound." 

2) Parameters. Each command could have one or more parameters 
associated with it. For instance, "raise Dolby sound to level 5." 
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3) Start Offset and Duration. A command could have a start offset and 
duration associated with it to indicate when the command becomes 
active during the course of a program. (A negative start offset could be 
used to indicate that the command becomes active before a program 
5 begins.) More than one start offset and duration could be provided to 

make a command active during different portions of a program (e.g. 
mute commercials). 

A detailed example of a possible tag format follows, although many 
different tag formats and instructions are possible: 
10 <command [parami, param2, . . .7 > 

-or- 

<OFFSET start1;duration1, [start2;duration2, start3;duration3 ...;> 

<command [param 1, param2, ...]> 
</OFFSET> 
15 In this example, . 

• "<>" indicates the beginning and end of a tag. 

■ "Command" indicates an instruction to the STB application. 

■ "Param" indicates a parameter associated with the command. 

■ "OFFSET" and 70FFSET" is used to indicate that the enclosed 

20 command(s) begin at some offset from the beginning of the program. 

■ "Start" is the starting offset from the beginning of the program. 

■ "Duration" is the length of time the command is valid from the specified 
"Start" offeet. If Duration is not specified, the command remains in 
effect until the end of the program or until some other event occurs. 

25 Here are some examples of how this tag format could be used to 

instruct the STB to configure home audio equipment and lighting for a Pay- 
Per-View event: 

PPV Command : <LT1 50%> <ST„VOL 20%> <ST_EQU 
80.50,60,65,70> <ST„SUR AC3> 
30 In the PPV Command: 

" "LTr. "ST_VOL", "ST^EQU", and "ST_SUR" are instructions to set 
room lighting, stereo volume, stereo equalization, and stereo surround 
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sound, respectively when the program begins. 

■ "50%". "20%", "80,50,60.60,70", and "AC3" are parameters used by 
each of the above instructions. 

Blocl^ Command : <OFFSET 00:05:13; 5, 00:19:32; 20> <BLOCK- 
5 MUTE PG-13></OFFSET> 

in the Blocl< Command: 

■ "BLOCK-MUTE" is a command to mute objectionabie portions of a 
program if the user has the option activated. 

■ "PG-IS" is the rating level the user's STB setting would have to match 
10 or exceed in order for the muting to take place. 

■ "00:05:13; 5, 00:19:32; 20" are two different start offset and duration 
pairs, meaning that the command will be active at two different times 
during the program. 

Tags may be inserted into a variety of places in the program data. A 
15 new data field could be created to accommodate the tags or the tags could be 
added to an existing EPG data field such-as tlie program description. The 
latter option is optimal since it can use existing EPG data formats such as 
DVB-SI. 

For instance, the tag could be encoded as an ASCII text string and 
20 added to the end of a program's description. The STB application would 
recognize the tag and act on its instructions. However, the STB application 
would not display the actual tag string to the subscriber when the subscriber 
displays the program description. 

C. System Capabilities 

25 Using the system described above, a number of control capabilities 

may be programmed into the EPG data allowing a broadcast provider to offer 
new and enhanced programming and supplemental products. In addition, 
users are able to optimize and enhance their television programming. For 
example, the user could have the ability to adjust, enable or disable any 

30 aspect of any application listed below. For instance, the user could disable 
automatic stereo control for air programs or mal<e it active only for purchased 
IPPV programs. The following Is a listing of some of the enhanced 
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capabilities of the present invention: 

• Stereo Amplifier Control . The STB application may use existing EPG 
data or special tags embedded in the program data to adjust a stereo 
amplifier. For instance, existing EPG data such as a program's AC-3 

5 Indicator could be used by the STB application to put the stereo into 

AC-3 mode during a program. Special tags could be added to program 
data to do such things as adjust the stereo volume, stereo equalizer, or 
speaker levels. At the end of the program, stereo settings could be 
restored to their original or default settings. 

10 • TV Control . The STB application could use tags embedded in the 
program data to adjust different aspects of a television set. For 
instance, tags could adjust picture or sound settings to best 
accommodate a particular program. At the end of the program, picture 
or sound settings could be restored to their original or default settings. 

15 • Lighting Control . The STB application could use existing EPG data 

such as a program's start and end times or special tags embedded in 
the program data to control room lighting. For instance; room lights 
could be set to automatically dim at the start of a purchased IPPV 
program and then brighten at the end of the program. Also, special 

20 tags could instruct the STB application to brighten room lights during 

TV commercials, allowing the user to find their way to the kitchen. 

• Other Home Automation Control . The STB application could use 
existing EPG data such as a program's start and end times or special 
tags embedded in the program data to control other parts of a home 

25 automation network. For example, at the start of a program, the STB 

application could automatically mute a telephone ringer, adjust window 
shades, adjust room temperature, or activate a popcorn popper. 

• . Commercial Mute/Replace . The STB application could use tags 

embedded in the program data to mute volume, or tune to a special 
30 channel or video input during TV commercials. 

• Dvnamic Parental Controls . The STB application could use tags 
embedded in the program data to mute or blank portions of a program 



10 



wo 01/99435 PCT/USOl/08465 

that exceed a certain parental control rating. 

• On-Screen Graphics and PIP Display . The STB application could use 
tags embedded in the program data to enable or disable on-screen 
displays generated by the STB or some other consumer electronics 

5 device. Also, tags could be used to automatically enable, disable or 

configure a Picturenn-Picture (PIP) display. 

• Motion Simulator . The STB application could use tags embedded in the 
program data to control a motion simulator or a feedback device such 
as a chair that vibrates. 

10 • Aroma Generator . The STB application could use tags embedded in 
the program data to control an aroma generator. The aroma generator 
could generate aromas that coaespond to the content of a program, 

III. System Overview- PDA Reminder Exchange 

Figure 3 shows system components for connecting the STB to a PDA. 
15 In the subscriber's premises, a Set-Top Box 3 is connected through a 

distribution network 2 to a Headend or Transmission Facility 1 Set-Top Box 3 
is also connected to the subscriber's Personal Digital Assistant(PDA) 4. An 
EPG Data Server 5 in the Headend or Transmission Facility 1 provides Set- 
Top Box 3 with program information on each'TV program such as program, 
20 title, start time, duration and description. 
A. STB - PDA Connection 

Set-Top Box 3 can be connected to a Personal Digital Assistant 4 
through a variety of means. Some detailed examples are listed below. Note 
that the hardware details of the STB-PDA connection are not the main focus 
25 of this invention, which may be implemented over a number of platforrhs. 
1) Using an IR blaster connected to the STB's IR blaster port, the STB could 
send IR signals to a PDA with a built-in IR receiver. Also, the PDAs built- 
in IR transmitter could be used to send I R signals to the existing IR 
receiver on the STB for two-way communications. (Figure 4A) 

30 2) Using the STB's serial port, the STB could be connected to a data 

communications port on the PDA. This means of communication would 
offer two-way data transmission. (Figure 4B) 
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3) Using a peripheral connected to the STB's expansion bus (e.g. an 
Ethernet card), the STB could be connected to a data communications 
port on the PDA. This means of communication would offer two-way data 
transmission, (Figure 4C) 

5 B. System Capabilities 

A STB application such as an Electronic Program Guide (EPG) would 
be enhanced to send and receive information to and from a PDA using the 
system described above. In this embodiment, the following applications could 
be supported. 

10 1) Set PDA Reminders . While watching television, the user sets 

reminders for current or future programming using the enhanced EPG 
application mnning on the STB. After program reminders are set, the 
user positions the PDA in front of the STB's IR blaster (or connects the 
PDA to the STB via some other hardware configuration, as shown in 

15 Figures 4A-G, and the enhanced EPG application communicates these 

reminders to a special application residing on the PDA. The special 
PDA application adds the program reminder as an entry in the PDA's 
built-in calendar application. It also configures the calendar application 
to notify the user with a visual and/or audible alarm before the start of 

20 the program. Of course, instead of using the PDAs built-in calendar 

application, the special PDA application may be designed to periderm 
these functions on its own. 

2) Display EPG Info from the STB on the PDA. The enhanced EPG 
application residing on the STB sends EPG program data to software 

25 residing on the PDA for storage and display. 

3) Schedule EPG Reminders or Recordings . After EPG program data 
has been sent to the PDA, the user sets program reminders and/or 
schedules program recordings on software residing on the PDA. At 
some point later in time, the PDA transmits the settings to the 

30 enhanced EPG application residing on the STB, which in turn sets 

program reminders and schedules program recordings within the EPG 
application. 
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IV. System Overview - PC Interlink 

Briefly, Figure 5 shows a variety of system components for connecting 
and communicating between a STB and a PC. In the subscriber's premises, 
Set-Top Box 3 is connected through distribution networi< 2 to Headend or 

5 Transmission Facility 1 . Set-Top Box 3 is also connected to the subscriber's 
Personal Computer (PC) 4. PC 4 is connected to the Internet through an 
Internet service provider. Of course, instead of STB 3, the invention could be 
implemented using software and hardware associated with some other CE 
Device such as a TV, VCR, or DVD Player. 

10 A. STB - PC Connection 

Set-Top Box 3 can be connected to Personal Computer 4, in Figure 5, 
through a variety of means. Some detailed examples are listed below. 

1) Using the IR blaster port, the STB could communicate with a PC using 
one of the following two means. These means of communication offer 

15 only one-way data transmission at slow speeds. 

(a) An IR blaster connected to the STB's IR blaster port could send 
IR signals to an IR receiver peripheral connected to a standard port 
on a PC. (Figure 6A) 

(b) The STB's IR blaster port could send electrical signals directly to 
20 a peripheral connected to a standard port on a PC. The peripheral 

would translate the electrical signals sent out via the STB's IR 
blaster port into signals understood by one of the PC's standard 
ports. (Figure 6B) 

2) Using the STB's serial port, the STB could be connected to the PC's 
25 serial port. This means of communication would offer two-way data 

transmission at moderate speeds. (Figure 6C) 

3) Using a peripheral connected to the STB's expansion bus (e.g. an 
Ethernet card), the STB could be connected to a standard port on a 
PC. This means of communication would offer two-way data 

30 transmission. (Figure 6D) 

4) Using the STB's modem phone port, the STB could communicate with 
a modem connected to the PC. This means of communication would 
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offer two-way data transmission. (Figure BE) 
B. Data Tags 

Referring to Figure 5, Headend or Transmission Facility 1 houses an 
EPG Data Server 6 that collects program data from a data provider. The 

5 program data includes infomnation on each TV program such as the program 
title, start time, duration and description. The EPG Data Server sends the 
program data to an "Internet Tag Server" 7 that inserts special data referred to 
as "tags" into the program data for particular TV programs. 

. The tags act as instructions to a STB application to retrieve Internet 

10 data from a PC. Before retrieving this data, the tag could include instructions 
for presenting the subscriber with different data retrieval options. For 
instance, a tag in the program data for a baseball game could instruct the STB 
to display options on the TV screen called "Batter Statistics" and "Pitcher 
Statistics." If the subscriber selects the "Batter Statistics" option, the tag 

15 instnjcts the STB to retrieve statistics on the current batter from a PC 
connected to the Internet and display them on the TV screen. 
A tag may include the following elements: 

1) Command . A tag would include a command such as "fetch Internet 
data from a PC" or "display a menu of data retrieval options to the 

20 subscriber." Also, in addition to retrieving Intemet data, commands 

could do other things such as "bookmark a web site on the subscriber's 
PC." See the "System Capabilities" section below for further examples. 

2) Command URL. A command could have a URL associated with it. 
The URL could be a normal Internet URL such as "www.bellsouth.com" 

25 or, to save memory, the URL could be represented in some shorthand 

notation, e.g. "wbis". understood by the STB or PC applications. 

3) Command Parameters . A tag command could have one or more 
parameters associated with it. For example, the command to display a 
menu of data retrieval options to the subscriber could have a 

30 parameter that indicates the format that the menu options are to be 

displayed In. Another parameter might indicate when the menu should 
be displayed. For instance, a menu could be displayed while the 
subscriber is watching the TV program or when the subscriber calls up 
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EPG information on the program. 

4) Menu Option Names . A tag couldlist tfie names of menu options to be 
displayed to tlie subscriber. 

5) Menu Option Actions . A tag could include instructions on what to do if 
5 the subscriber selects a particular menu option. For instance, an 

action might be to retrieve and display a specific type of data from an 
Internet site. 

6) Menu Option Parameters . A tag . could include, parameters for a menu 
option. For instance, a parameter could instruct the STB application on 

10 how to display results when a menu option is selected. 

A detailed example of a possible tag fonnat follows, although many different 
tag formats and instructions are possible. 
<command URL [parami, param2,..J > 

[<menuoption1 actioni [param1,param2,..J>, 
1 5 < menuoption2 action2 [param 1,param2, . . .;> 

</command>] 

Here is an example of how the tag format could be used to present the 
subscriber with menu options and retrieve supplemental EPG data for the 
20 movie "The Matrix". The following represents an embedded command for that 
movie: 

<DISPMENU wbls/matrix descript,buttons1> 
<"D{rector Bio" DispData=director box1> 
25 <"Cast Notes" DispData^cast box1> 
</DISPMENU> 
In this example, 

■ "DISPMENLT is a command to display menu options for the program 

■ "wbls/matnY is shorthand notation for a special web URL setup to provide 
30 data for the program. In this example, "wbls/matrix" is shorthand notation 

for the web URL "www.bellsouthmovies.com/matrix". 

■ ""descriptbuttonsr are command parameters. In this example, "descript" 
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indicates that the menu should be displayed when the subscriber calls up 
the program's description box. and "buttonsl" indicates a standard format 
in which to display the menu options. 

■ "Director Bio" and ''Cast Notes" are the names of the menu options to 
5 display to the subscriber. 

■ "D/spDafa=director" and "DispData-cast" are the actions the STB 
application should take when the subscriber selects the menu options. In 
these cases, the STB application will retrieve data on the director or cast 
notes from the web URL "wbls/matrix" 

10 ("www.bellsouthmovies.com/matrix"). 

■ "ftox^" indicates the fornnat in which to display the resulting data. 

Tags can be inserted into a variety of places in the program data. A 
new data field could be created to accommodate the tags or the tags could be 
added to an existing EPG data field such as the program description. The 

IS latter option is optimal since it can use existing EPG data fomnats such as 
DVB-SI. For instance, the tag could be encoded as an ASCII text string and 
added to the end of a program's description. The STB application would 
recognize the tag and act on its instmctions. However, the STB application 
would not display the actual tag string to the subscriber when the subscriber 

20 displays the program description. 
C. System Capabilities 

Using the system described above, the following capabilities could be 
supported: 

1) Supplemental program information . Existing EPG data for a current or 
25 future event is supplemented by data retrieved from a PC attached to 

the Internet. The additional data can be displayed on the TV screen as 
part of the EPG data or displayed on the PC screen in a special 
window. Multiple options may be presented. For example, the STB 
application may display a menu giving the subscriber the ability to 
30 retrieve data on a show's cast or call up trivia on the particular episode. 

2) Real-time data . Data is synchronized to a currently playing event. For 
instance, current pitcher and batter statistics could be provided during 
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a baseball game. The STB application could present a menu in the 
bottom comer of the screen allowing the subscriber to display statistics 
on either the pitcher or batter. If the subscriber selects an option, the 
STB application requests the infonnation from the PC. The PC, in turn, 
visits a special web site that provides data that is specially formatted 
and synchronized to a TV channel being viewed. The statistics on the 
current pitcher or batter are then displayed in a window (e.g., a picture 
in picture or PIP window) on the TV screen. 

3) PC browsing . The STB application allows the subscriber to display 
related data on a current or future event on the subscriber's PC. The 
data could be displayed on the PC in several different ways. For 
instance, the data could be part of a web page that is automatically 
called up in a web browser such as Netscape. The data could also be 
stored on the PC for later viewing. 

4) Automated bookmarks . Instead of going ahead and displaying a 
related web page on the PC, the STB application could instruct the PC 
to store a web page as a bookmark for later viewing. 

5) Purchasing . The STB application allows the subscriber to purchase 
products related to a current or future event over the Internet. While 
the STB application would initiate the purchase, the complete purchase 
process could take place on the STB or the PC. 

6) Calendar reminder . The STB application could instruct the PC to add 
the name and start time of an event to a calendar application on the 
PC. The calendar application would alert the subscriber to when an 
event begins. The calendar application could interface with a personal 
digital assistant such as a Palm Pilot, etc. by downloading information 
when the PDA is synchronized with the calendar function on the PC. 

7) Printing . The STB application could send event information to a PC 
and instruct the PC to print the event information on a printer 

8) Screen capture . The STB application could send a screen capture to 
the PC for use in a variety of PC applications. 

9) Bill review . The STB application could instruct the PC to retrieve the 
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subscriber's billing information fronn the Internet for display on the TV 
or PC. 

lO Mnteractive help . The STB application could instruct the PC to retrieve 
interactive help from the Internet for display on the TV or PC. 

5 While this invention has been described in conjunction with specific 

embodiments, it is evident that many alternatives, modifications, and 
variations will be apparent to those skilled in the art. Accordingly, the 
preferred embodiments of the present invention that are here described are 
intended to be illustrative and not limiting. Various changes may be made 

10 without departing from the true spirit and full scope of the invention as defined 
in the following claims. 
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1 1 . A method for obtaining information related to broadcast programming, 

2 the method comprising: 

3 a. adding at feast one data tag to electronic program guide (EPG) 

4 data, wherein the at least one data tag contains detail control 

5 information relating to broadcast programming, the data tag 

6 consisting of one or more of the following elements: (1) a command, 

7 (2) at least one parameter, (3) command URL (4) menu option 

8 names. (5) menu option actions, (6) menu option parameters, and 

9 (7) a start offset and duration; 

10 b. transmitting the EPG data and the at least one data tag to a viewer; 

11 c. receiving the transmitted EPG data and the at least one data tag by 

12 the viewer; 

13 d. using the at least one data tag to obtain related programming 

14 information from the internet. 

1 2. The method of claim 1 , in which the using the at least one data tag 

2 further comprises using the at least one data tag to obtain 

3 supplemental electronic program guide data from the internet for 

4 current or future programming events. 

1 3. The method of claim 1 . in which the using the at least one data tag 

2 further comprises using the at least one data tag to obtain real-time 

3 data from the internet that is synchronized to the program. 

1 4. The method of claim 1 , in which the using the at least one data tag 

2 further comprises using the at least one data tag to link to at least one 

3 website that contains related information to the program. 

1 5. The method of claim 1 , further comprising displaying the related 

2 program information. 

1 6. The method of claim 5, wherein the related data is displayed on a 
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1 1, The method of claim 5, wherein the related data is displayed 

2 simultaneously with the program on a consumer electronic device. 

1 8. The method of claim 5, further comprising purchasing the program 

2 using the internet. 

1 9. The method of claim 1 , Hirther comprising storing the related 

2 infomiation in a storage device for later retrieval. 

1 10. A method for using electronic program guide (EPG) data for 

2 programming and monitoring broadcast events, the method 

3 comprising: 

4 a. receiving EPG data on a consumer electronic device, wherein 

5 the data comprises (1) content data, (2) control data, or (3) both 

6 content and control data; 

7 b. interfacing the consumer electronic device with a personal digital 

8 assistant (PDA); 

9 c. communicating between the PDA and CE. 



1 11. The method of claim 1 0, in which interfacing further comprises using a 

2 serial cable interface to connect the CE and the PDA. 

1 12. The method of claim 1 0, in which interfacing further comprises using an 

2 inferred blaster interface to connect the CE and PDA. 

1 13. The method of claim 1 0, in which interfacing further comprises using an 

2 expansion bus interface to connect the CE and PDA. 

1 1 4. The method of claim 1 0, in which the communicating comprises using 

2 the PDA to program the CE to automatically record a programming 

3 event. 
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1 1 5. The method of claim 1 0, further comprising downloading at least one 

2 portion of the EPG data to the PDA, wherein the downloaded 

3 information is used by the PDA to monitor a schedule of programming 

4 events. 

1 16. A method for controlling and managing the presentation of programs 

2 the method, comprising: 

3 a. adding at least one data tag to electronic program guide (EPG) 

4 data, wherein the at least one data tag contains detail control 

5 information relating to broadcast programming, the data tag 

6 consisting of one or more of the following elements: (1 ) a command , 

7 (2) at least one parameter, and (3) a start offset and duration; 

8 b. transmitting the EPG data and the at least one data tag to a viewer; 

9 c. receiving the EPG data and the at least one data tag; 

10 d. presenting a program associated vTith the at least one data tag at 

1 1 the viewer's location; 

12 e. using the at least one data tag to control the presentation of a 

13 program; and 

14 f. modifying the presentation of the program in real-time using the at 

15 least one data tag. 

1 17. The method of claim 16, wherein using the at least one data tag further 

2 comprises using an inferred blaster interface to transmit the at least 

3 one data tag between a first and a second consumer electronic device. 

1 18. The method of claim 16, wherein using the at least one tag data further 

2 comprises using a serial interface to transmit the at least one data tag 

3 between a first and a second consumer electronic device. 

1 19. The method of claim 16, wherein using the at least one tag data further 

2 comprises using an expansion bus interface to transmit the at least one 

3 data tag between a first and a second consumer electronic device. 



20. The method of claim 16, in which modifying the presentation further 
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2 comprises modifying tine volume of ttie program based upon the at 

3 least one data tag. 

1 21 . The method of claim 16, In which modifying tiie presentation further 

2 comprises modifying the program presentation during commercials. 

1 22. The method of claim 21 , In which modifying the program presentation 

2 during commercials comprises muting the volume. 

1 23. The method of claim 21 , in which modifying the program presentation 

2 during commercials comprises automatically displaying altemate 

3 programming during the commercial. 

1 24. The method of claim 1 6, further comprising modifying the viewing 

2 environment. 

1 25. The method of claim 24, in which modifying the viewing environment 

2 further comprises modifying the room lighting based upon the at least 

3 one data tag. 

1 26. The method of claim 24, in which modifying the viewing environment 

2 further comprises controlling a motion simulator using the at least one 

3 data tag associated with the program being displayed. 

27. The method of claim 24, which modifying the viewing environment 

further comprises operating a aroma generator to generate aromas that 
correspond to the content of the program using the at least one data 
tag. 

5 
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Figure 4A: IR Interface 
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Figure 5: System Overview 
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Figure 6A: IR Blaster to IR Receiver Interface 
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Figure 6E: Modem Interface 
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